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(54) DEVICE AND METHOD FOR DETECTING OBSTACLE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To fast detect an obstacle existing on a road 
surface with high accuracy even though stereo cameras are not corrected 
and even under a situation in which there are changes in vibrations during 
traveling and in slopes on a road surface by using the stereo cameras on a 
vehicle. 

SOLUTION: This obstacle detecting device consists of a plurality of 
uncorrected TV cameras inputting images, an image storing part 2 for 
storing a plurality of images inputted by the plurality of TV cameras, a 
characteristic extracting part 3 extracting a plurality of mutually parallel 
lines existing on a road surface, a parameter calculating part 4 calculating a 
relational expression established among projected positions to each image 
of an optional point on the road surface from the plurality of lines extracted 
by the part 3. and a detecting part 5 which uses the relational expression 
calculated by the part 4 and detects an object having height from the road 
surface. 
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[0002] 

[Conventional technique] Techniques for the purpose of detecting 

an obstacle by a sensor are largely categorized into two groups, i.e., 
ones using laser or ultrasonic waves and ones using a video camera. 
The ones using laser are expensive and hence impractical. Comparably, 
the ones using ultrasonic waves are low in resolution thereof and hence 
there is a problem in accuracy of detecting an obstacle. 
[0003] Contrarily, a video camera is comparably inexpensive and 

is suitable to detecting an obstacle in terms of resolution, measurement 
accuracy and measurement range. In the case of using a video camera, 
there are method of using a single camera and that of using a plurality 
thereof (a stereo camera) . 

[0004] A method of using a single camera separates a road zone from 

an obstacle zone by using information, as a clue, such as brightness, 
color or texture of a single image photographed by the camera. The 
method, for instance, acquires a road zone by extracting a middle grade 
brightness zone with a low saturation within an image, that is, a gray 
zone, or extracts a road zone by acquiring a zone with a small amount 
of texture, and regards other zones as obstacle zones. However, there 
are many obstacles having a similar brightness, color or texture to 
a road, and therefore it is difficult to discriminate an obstacle zone 
from a road zone under a usual condition. 

[0005] Contrarily, a method of using a plurality of cameras detects 

an obstacle by using three-dimensional information as a clue. A 
technique for obtaining three-dimensional information of a target scene 
by using a plurality of cameras is generally called a stereo view. The 
stereo view places two cameras on the left and right for example, 
correlates a point, which is a single point in a three-dimensional space, 
between the left and right images and acquires a three-dimensional 
position of the point by the art of triangulation . An acquisition of 
a position, an attitude, et cetera, of each camera relative to the road 
plane in advance enables acquisition of a height, from the road plane, 
of a discretionary point within an image by way of the stereo view. 
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Therefore/ it is possible to discriminate an obstacle zone from the 
road zone by a presence or absence of the height* Although the method 
of using a single camera has a difficulty of detecting a zone having 
similar brightness, color or texture to a road as an obstacle, the stereo 
view detects an obstacle by a height thereof from the road surface as 
a clue, thereby enabling a detection of an obstacle in more common 
scenes . 

[0020] It is assumed that a road plane changes from a reference 

plane Z= 0 to an inclined plane Z= pY due to an inclination change of 
the road or a vibration of the vehicle itself at the time of driving 
the vehicle (Fig. 4) . The inclination in the X direction as compared 
to that of the Y direction is generally so small as to be negligible 
and hence the equation of the inclined plane can be expressed by Z= 
pY, where the intersecting line between the inclined plane and reference 
plane is defined as X axis. A method for enabling a calculation of a 
road plane constraint relative to Z= pY from a movement of two white 
lines (Fig. 7) is shown. A pro j ected position (u' , v' ) of a point (X, 
Y, Z) on the inclined plane to the image, when substituting Z= pY for 
the expression (2), under the above described two premises: 

(10) 

Here, assuming the inclination is minimal, that is, p- 0: 
(11) 

Let Yc= Y + 3, and modifying the expression relating v' based on the 
expression (3) : 

(12); 

where (u'o/ V o) t' is a disappearance point of two white lines. 
Letting Au= (A^, £^v)^= u-t, and Au'= (A^' / Av')^= u'- t', then Au= MX from 



the expression (7) and therefore the above expression 



(13) ; 

where, At= (Auo, Avo)^= t - from the expression (7) ; 

hence [Expression 13] is: 

(14) , 

and letting the [expression 14] be, 
(15) 

then it becomes l/yc= m^jAu + m^^Av^. Therefore the expression (13) is: 
(16) / 

where, /3i= m2ii8, /32= m22/3. 

Letting a white line on one side of the image change from 
ii: Av= piAu to i'l: Av''= p'lAiz' 

due to an inclination as shown by Fig. 7, then obtains from the expression 
(16), 

(17) 

Modifying the expression relating to another white line (I2 to 1' 2) f 
obtains : 

(18); 

and thus two linear equation relating to /3= (pi, ^82)*^. Acquiring /3 from 
these, a determination K of the expression (16) can be acquired. 
Carrying out the above described processing for each of the left and 
right images, then the projected position of a point on the road plane 
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is converted into Au'i = fCiAui , AUr = JCrAUr due to a change of the 
inclination. 

Therefore, using the expression (9), obtains; 

(19) ; 

thus resulting in "'A" in the expression (9) changing to A'= KrAKi -1 
The expression (19) is the road plane constraint relating to an inclined 
plane. 

[0021] A detection unit 5 detects an obstacle by using the road 

plane constraint acquired by a parameter calculation unit 4. It 
acquires a corresponding point (Ur, Vr) in the right image from the 
expression (19) in the case of assuming that a point (u, v) exists on 
the road plane, with the brightness XL of a discretionary point (ui, 
vi) in the left image being IL (ui, vi) and determines the brightness 
to be IR (Ur/ Vr) . If the point (u, v) exists on the road plane, the 
points P and P' are correctly corresponding pair, and therefore the 
brightness of the points P and P' are basically the same. That is; 

(20) ; 

the point P where Dt^ 0, or D > Thr (where a Thr is a threshold value 
set in advance) by considering an error is judged as belonging to an 
obstacle zone. 

[0022] As mentioned above, it is possible to detect an obstacle 

on the road plane from stereo camera installed by the vehicle at the 
time of driving the vehicle. 
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